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(57) ABSTRACT 

A video jukebox service has a world-wide array of file 
servers interconnected by data links and having video input 
apparatus. Each file server has a plurality of connected 
clients. Video clippings input at the video input apparatus 
are shared with the other file servers and stored in a database 
at each file server. Clients are notified of availability of video 
clippings, and clippings are downloaded to client stations on 
demand. In a preferred embodiment, the file server network 
is a toriodal arrangement, and client communication nodes 
equal in number to the number of file servers are intercon- 
nected in a toroidal fashion as well. Individual client stations 
are connected to individual ones of the client communica- 
tion nodes, with the overall network in the form of nested 
toroids. 
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TRANSMITTING NOTIFICATION OF NEW 
VIDEO CLIPS OF INTEREST FROM 
SERVERS IN WIDE AREA NETWORK 

CROSS REFERENCE TO RELATED 
DOCUMENTS 

The present patent application is a divisional of applica- 
tion Ser. No. 08/885,676, filed Jun. 30, 1997 and entitled 
"Server for Notifying Items of Interest and Delivering 
Locally Accessed Video in a WAN to Client Stations on 
Demand," now U.S. Pat. No. 6,163,795, which is a divi- 
sional of application Ser. No. 08/41 9,021 , filed Apr. 10, 1 995 
and entitled "Video Collection and Distribution System with 
Interested Item Notification and Download on Demand /' 
now U.S. Pat. No. 5,644,714, which is a continuation-in-part 
of Application Ser. No. 08/182,282, filed Jan. 14 , 1994 and 
entitled "Communications Internetwork System Connecting 
a Client Node Array to a Resource Array," now U.S. Pat. No. 
5,515,510. 

FIELD OF THE INVENTION 

This invention is in the area of information services, and 
pertains in particular to a service for providing customers 
selected video information, such as news events and events 
of special interest, to client in a timely manner. 

BACKGROUND OF THE INVENTION 

There are presently available services that select video 
information from available sources, such as network news 
and other TV programming, and deliver such information to 
clients. These services fall into two basic categories. A first 
type of such a service reviews available materials and 
compiles selected tapes categorized by specific topics. After 
the time required to preview available materials and compile 
the tapes, customers who have subscribed for specific cat- 
egories of information are provided copies of the tapes by 
commercial carrier. 

In this first type of video delivery service, a delivered 
video tape on the selected topic or topics is played by the 
client in a conventional VCR. In a variation of the same 
service delivers organized video information by CD-ROM, 
which is then viewed by the client on a computer video 
display using a CD-ROM drive in conjunction with suitable 
software executed on the computer. 

A second type of video delivery service is available by 
computer on-line services, such as COMPUSERVE, 
PRODIGY, and DIALOG, wherein a user may conduct a 
search, or may pay an intermediary to do the search, for 
information on substantially any topic of interest. In the case 
of on-line services, a modem installed in or connected to a 
user's computer is utilized for communicating with the 
on-line service's host and transmitting or receiving infor- 
mation. Communication is over the installed telephone 
network. 

With a service based on use of individual media, such as 
video tapes and CD-ROM disks, there is an inherent delay 
associated with physically organizing subject matter and 
recording on the deliverable recording media. Time lapse 
between a real event and delivery of the video tape or 
CD-ROM may be from several hours to several days. 

The second type of video service, based on computer 
on-line access, although providing a more ready response 
than the deliverable media service, is still rather slow, and is 
certainly not user-friendly. At a typical transmission rate of 
14.4 kbaud in some faster modems, the time required to 
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download a single video selection may be from 10 to 30 
minutes or more, depending on the size of the file. Data 
compression schemes may be used to reduce the size of a file 
before transmission, but major improvements in overall 

5 response time are still needed. 

What is needed is a video jukebox service, a video 
information service that monitors conventional video 
sources, and alerts its clients to selected topics as soon as a 
selection becomes available, and also permits clients to 

10 select for downloading only those items the client wishes to 
view. Preferably, such a service would be scaled to the needs 
of different clients, having a low-end version operable on 
existing personal computer hardware systems, and a high- 
end version requiring special equipment, but having faster 

15 transmission and enhanced display quality. 

SUMMARY OF THE INVENTION 

In a preferred embodiment, a video jukebox system is 
provided. The system comprises a plurality of computerized 

20 file server stations interconnected in a network by first data 
links, with individual ones of the file server stations also 
connected to a video input apparatus, such as a VCR device 
or other device capable of providing video input to the 
connected file server. There is a plurality of client stations 

25 connected by second data links to individual ones of the file 
server stations. Each file server station with a video input 
apparatus accepts video clippings from the video input 
apparatus, stores the clippings in a database, and shares the 
video clippings with other file servers in the network over 

30 the first data links, and wherein each file server notifies 
connected clients of new video clippings available, and 
downloads video clippings to clients on demand. 

Also in a preferred embodiment, each file server has 
transactional control routines for tracking client transactions 

35 and billing clients. In an alternative embodiment, such 
transactional accounting may be the business of a dedicated 
file server in the network. 

In various embodiments of the system of the invention, 

4Q data links can be of various sorts, with a preferred data link 
being an Integrated Services Digital Network (ISDN) link. 
In some cases, for clients wishing to have a less expensive 
system, analog telephone modem links may be used. 
In an alternative embodiment of the invention, clients are 

45 connected to the system at client communication nodes 
configured to route messages and packets of data in the 
system. The client communication nodes are connected 
together in a toroidal array, the file server stations are 
connected in a toroidal array, and each client communication 

50 node is connected to a file server, there being an equal 
number of client communication nodes and file servers. 

The video clipping service of the present invention, 
referred to by the inventor as a video jukebox, provides a 
system for allowing clients access to video clippings of news 

55 events and other valuable information much quicker than by 
any known conventional service. The distinct advantage is 
that such information rapidly declines in value with age for 
most purposes. 

BRIEF DESCRIPTION OF THE DRAWINGS 

60 

FIG. lAis a diagram of a global network architecture for 
a video jukebox system in an embodiment of the present 
invention. 

FIG. IB is a diagram showing a file server of FIG. 1A in 
65 more detail. 

FIG. 2 is a diagram depicting control flow in some critical 
automated operations at the file server of FIG. IB. 



04/19/2004, EAST Version: 1.4.1 



US 6,490,725 B2 

3 4 

FIG. 3 is a schematic representation of a connection selected for addition to a worldwide database are cross- 
between a client station and a file server in an embodiment referenced according to an index, which lists each clipping 
of the invention. under all possible topics of interest. For example, a video 

FIG. 4 is schematic representation of an alternative con- CU P of 411 oil rig explosion in the gulf of Mexico may be 

neection between a client station and a file server. 5 indexed under petrochemicals, environmental news, events 

FIG. 5 is a diagrammatical illustration of a massively m Gulf of Mexico > worldwide disasters, and so on. 

parallel network architecture according to an embodiment of Clippings compiled and cross-indexed at each server site 

the invention. are transmitted at regular intervals in a high-resolution video 

FIG. 6A is an isometric drawing of a massively parallel format to aU othcr filc servcr sitcs m ^ worldwide network. 

network device according to an embodiment of the inven- 10 For exa *P le > sha ring b ^ between servers may be timed 

t j on to occur at five-minute intervals. Clippings transmitted from 

mr- - , • j * r , each server site are stored for ready retrieval at all other 

HG. 6B is an isometric drawing or a portion of the J 

f • c £ a r server sites, 
network device of FIG. 6A. 

FIG. 7 is a plan view block diagram of a microprocessor 15 Al each ™. ^ aU <*V&& «!? n ? ^ for 

node according to an embodiment of the invention. fransmission to chents are represented in the database by a 

r-- a . . , . . . bnef synopsis (abstract), the date acquired, and, in some 

FIG. 8 is a two-dimensional view section through a L.. *• ♦ * c 

. . „ . . . - cases, by other pertinent information, 
massively-parallel network according to an embodiment of 

the invention Paying clients of the video service, at the time of 

cin 0 . ' e a * t *• j in subscription, specify the topics of their particular interest 

FIG. 9 is a diagram of a data stream representing video 20 r ' r ' . r . . r 

data com risin a movie and provide details of their local receiving equipment, which 

a i tf°™? riSin ^. a m0Vie '.„ . r . must be of a type compatible with the worldwide network. 

15 ™ isometric illustration of a massively parallel ^ ^ a QCW clipping k made avai i aD i e , gfc severs in 

network according to an embodiment of the invention, each area ^ n6 a message to clients who have subscribed to 

configured as nested ton. ^ mc categories appropriate to the new clipping. 

DESCRIPTION OF THE PREFERRED Clients can monitor their service as often as they like for 

EMBODIMENTS newly available video in the areas of interest they have 

^ . . .„ . , . , , indicated, and can then select clippings they wish to see. 

FIG. 1A is a diagram illustrating a Video Jukebox world- ^ a client OQe or mofe di ^ ^ ^ daU 

wide architecture in an embodiment according to the present fc sent to the djem on the interconnecting link t0 me 

invention. File server 1, file server . ^ file server 5, and file m a essed modC) and mc client can eilhcr storc or 

server 7 are all interconnected by ISDN links 9, U, 13, and immediacy view me data ^ 

15 respectively. Servers 1, 3, 5, and 7 are exemplary of file . „ , . „ 

servers in such a network, and in other embodiments there A "G. " * a **>wing file server * » additional 
may be more or fewer such servers. ISDN links 9, 11, 13, dclad > and by example the architecture of all other file 
and IS interconnect rile servers 1, 3, 5, and 7 in this 35 servers m ^ global architecture. A CPU 2 and a random- 
embodiment in what is known as a token ring architecture. mcraor y CRAM) are connected to an internal bus 18, 
It will be evident to those with skill in the art that there are ^, h,ch also connects to network ports 10 and 30 that couple 
many other conventional architectures that may be used, and filc server 1 ^ othcr file SCIVCIS 00 thc nctwork ' 
the inventor discloses herein a unique architecture with Another interface 8 connects to at least one hard disk 
distinct advantages for such a unique video jukebox service. 40 drive 12. There may more than one such drive, and other 
The unique architecture is discussed in detail below. sorts of non-volatile memory may be used as well. The 
Each file server is also connected to local clients, as is also non-volatile storage provides space to store the numerous 
shown in FIG. 1A- File server 1 serves local subscribers 17, V1 f° clippings entered, cross indexed, and provided to 
19, and 21 over links 41, 43, and 45 respectively. File server subscribers on demand. 

3 serves local subscribers 23, 25 and 27 over links 47, 49, Yet another port 20 provides communication with video 

and 51. File server 5 serves local subscribers 29, 31, and 33 ^pul apparatus, which may be in any one of several forms, 

over links 53, 55, and 57. Lastly, file server 7 serves local such as one or more video tape units, television channel 

subscribers 35, 37, and 39 over links 59, 61, and 63. monitoring apparatus, and the like, encompassing all sorts of 

Referring still to FIG. 1A, it will be apparent to those with 50 vidco This apparatus allows video selections to be 

skill in the art that there are many network architectures well accessed and viewed by an operator, who then flags selec- 

known in the art that might be used for interconnecting the ^ P rovides ™ abstract and an identifier, and causes 

file servers, and the connections from file servers to clients annotated clippings to be input via port 20 and stored m 

need not be direct from each file server to each client as non-volatile memory 12. 

shown in FIG. 1A, but may be done by alternative known ss The operator who selects and annotates has access to the 

network architectures as well. system through a display 22 via a display port 24 and a 

In a Video Jukebox Service using the architecture of FIG. keyboard 26 via a keyboard port 28. Port 6 provides com- 

1A, or other interconnection architecture, individual file munication with subscribers 17, 19, and 21, and there may 

servers are located worldwide at major sites of customer b . e more subscribers connected in other network configura- 

concentration, such as major cities and capitals of various 60 llons - 

countries, such as Washington, D.C., New York City, and Control routines 16 reside in RAM 4 during operation, 

Los Angeles in the United States, London, Paris, Tokyo, and provide the unique functionality of the file server for 

Moscow, and so on. operation as a Video Jukebox according to the present 

At each server site, local employees are engaged in invention, 

reviewing and loading video generated in the local area. The 65 As was described above, the file servers are sited at 

video productions may be considered as video clippings, locations of customer concentration, coinciding as much as 

borrowing a term from the printed news media. Clippings possible with central location for monitoring major news 
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events and items of interest to subscribers. Considering file information, such as an updated list of available clippings on 

server 1 as described above to be so located, video clippings certain subjects. A decision is therefore made at step 54 as 

selected, annotated, and fed into the system at file server 1 to the nature of the request. If the request is not for clippings, 

arc made immediately available to subscribers 17, 19, and control is diverted to step 56 where appropriate routines are 

21, representing all subscribers connected to server 1. 5 executed and appropriate action taken, according to the 

In addition, the same video input, besides being stored in request. For example, the request may be for preview or 

non-volatile memory 12, is provided via ports 10 and 30 to listings, in which case stored information is received at step 

all other file servers in the global network, which store these 66, and the information is sent to the requesting subscriber 

clippings and make them immediately available to con- a * ste P 68. 

nected subscribers. Also, ports 10 and 30 function to receive io If the request from a local subscriber is for one or more 

video clippings from other servers on the global network, clippings, the requested clippings are retrieved at step 58 and 

which are then stored at server 1 and made available to sent to the subscriber at step 60. At step 58, assuming a 

subscribers 17, 19, and 21. request for downloading, another control path is initiated 

FIG. 2 is a flow diagram indicating the functionality of resulting in activation of an accounting, procedure at step 

control routines 16 executed on the file servers in the global 15 62. At step 64 the request is logged and billing information 

network of file servers. There are at least three different is updated. Subscribers are periodically billed at step 70, 

inputs that may be expected at a local file server: (1) an which may be done by an E-mail service, just as in sending 

operator-triggered and annotated local video input, which preview and listing information to subscribers, 

will be in most cases a new video clipping to add to the Periodic automatic billings arc made to each customer 

database (2) a compressed clipping received from another 20 complete with a history for the immediate period of all of the 

server, which will be in most cases a new clipping to be services requested, the individual prices, and the total 

stored and shared with local subscribers as well, and (3) a amount owed. In some case, wherein deposit accounts may 

request from a local subscriber, which in most cases will be be maintained, appropriate arithmetic is performed on a 

a request for downloading one or more clippings. customer's account to deduct an immediate billing automati- 

At step 32 a new annotated clipping is caused to be loaded 25 cally from a client's balance. It will be apparent to those with 

by an operator, and is recognized as such by control routines skill in the art that the control routines and steps for 

16. The control routines, recognizing the new annotated accounting may vary widely from the example given here, 

local clipping, execute a compression routine at step 34, and still be within the spirit and scope of the invention, 

which may be any of several conventional sorts. A suitable In addition to the functions described above with refer- 

compression protocol is the Motion Picture Experts Group 3 ence to FIG. 2, there are certain maintenance functions not 

(MPEG) protocol, which is a well-known industry standard shown that are typically performed by an operator, such as 

protocol. The new clipping is compressed. a systems administrator. For example, new clippings cannot 

At step 36 the new clipping is stored locally (FIG. 2, simply be added to the database forever. At some point 

memory 12). In the local storage, certain annotation, such as 35 clippings that are obsolete need to be removed. Deletion 

abstract and preview information, is stored to be accessible may be done only by an authorized administrator, but 

separately from the clipping itself (Step 38). Also, a copy of automated accounting may be used to track to times and 

the new clipping, together with the annotation, is burst at frequency of access of individual clippings. Other system 

step 40 to other file servers on the global network, to be administration functions are similar to such functions known 

stored and made available to subscribers connected to the 4Q in the art performed for information systems, 

other file servers on the global network, which also store the The distance between file servers in the global network 

clipping and make it available to locally-connected subscrib- for this video jukebox system is typically at least hundreds 

ers. Finally, at step 42, local subscribers who have indicated of miles. There are a variety of communication methods that 

an interest in the subject matter to which the new clipping might be used between servers, bearing in mind the very 

pertains are notified by a standardized protocol. This noti- 45 high data traffic that will be required and the need for quick 

fication is preferably in the form of E-mail which the transmission. In one embodiment the inter-server connec- 

subscribers may access at their leisure or pleasure. tions are ISDN telephone links. The connections in this case 

At step 44 a compressed input from a remote server is are hardwired. In other embodiments fiber optic and wireless 

received and recognized. In most cases a compressed packet communications, such as conventional microwave and sat- 

received from a remote server will be a new clipping being 50 ellite systems may be used. 

shared with other servers, but there are some instances in [ n a preferred embodiment, local subscribers are con- 

which other information might be received from a remote nected to a local file server also with a high-speed ISDN 

server, so a received packet has to be tested, which occurs at link. In an alternative embodiment subscriber connections 

decision step 46. are by modem over analog telephone lines. Such connec- 

If the received packet is other than a clipping, control ss tions arc not mutually exclusive, and several different con- 
diverts to step 48, and the received packet is processed nection protocols may be available at each server, and not 
according to instructions either prestored or received as a necessarily the same selection at all servers, to provide a 
part of the packet. If the received packet is a new clipping, sufficient range of subscriber flexibility, 
control goes to step 50, where the new clipping is stored FIG. 3 illustrates a user connection with a file server using 
locally to be available for downloading by locally connected eo a 128 KBaud ISDN interface. In FIG. 3, file server 65 has 
subscribers. At step 42 a message is sent to locally connected a complement of stored clippings in a memory system 75 
subscribers just as is done in the case of a new clipping available to subscribers, and the clippings are typically 
loaded locally. compressed, both to save storage space and to save trans- 

At step 52 a request is received from a local subscriber. mission time. ISDN interface 67 is connected to similar 

Such a request will, in most cases, be a request to download 65 interface 69 at a subscriber's site 71, which may be a home 

one or more clippings. There are other types of requests, or office. Requests are received at file server 65, and 

however, such as a request for billing information or preview compressed clippings, as requested, are uploaded and sent to 
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the subscriber according to the protocols described above systems may have layered hubs to provide connectivity to 

with reference to FIG. 2. Again, MPEG is a suitable com- more nodes while still using a single file server. 

pression format. The file server is limited by the bus connection to a 

User system 71 in this embodiment includes a MPEG conventional network during periods of heavy client use. As 

decompression engine 73 providing decompressed video s demand increases, data throughput to and from clients 

data to, for example, a Super VGA video adapter driving a saturates, and system performance is limited. To maintain 

high-resolution video monitor. Assuming a video clipping acceptable performance, conventional networks have incor- 

with a 30 second playing time, the ISDN interface at 128 porated second level servers that perform limited functions 

KBaud can transmit all the data in about 30 seconds, and the 0 f the primary server and eliminate waiting by clients in 

decompression engine can perform its function in about 15 10 some casc s. Typically, data is stored separate from the 

seconds. primary server and later, at a convenient time, such as once 

FIG. 4 illustrates another file server to PC connection a day or perhaps as often as once an hour, the secondary 

more suitable for less frequent or demanding clients. In this server downloads to the primary file server. In these systems, 

embodiment, server 77 is the same as server 65 in FIG. 3, real-time operation is not possible. Also, at higher demand, 

having MPEG compressed clippings in a memory 79, except is the bus systems for both the second-level servers as well as 

there port to communicate with clients is a modem port 81. the primary server saturate, and system-wide performance is 

A 14.4 KBaud modem is shown, but other transmission again limited. 

speeds may be used as well. In this embodiment the client's What is needed, especially for such systems as the video 

system 85 comprises software such as INDEO™ 87 for jukebox system described above, is a computer network 

receiving and decompressing the MPEG compressed clip- 20 architecture that maintains substantially real-time perfor- 

ping file. The software runs under an operating system such mance for large numbers of clients and resources, such as 

as Windows™ 91, and data is provided to a video monitor globally distributed file servers. 

89 through a Super VGA interface 90. FIG. 5 is a diagrammatical illustration of a massively 

Using the system with the connections shown in FIG. 4 parallel network architecture according to an embodiment of 

data for a video clipping can be transmitted to a client in 25 the present invention. One matrix 121A comprises sixteen 

about 6 minutes. interconnected client nodes (CN), Another matrix 121B 

Video Jukebox with a Massively Parallel Global Network comprises sixteen resource nodes (RN)- In the case of the 

For a video jukebox system according to the present Video Jukebox system described above, the client nodes are 

invention, given the global nature of the network and the clients, and the resource nodes are file servers in the global 

likelihood of very numerous clients for each of the file 30 network. 

servers as well as near continuous communication between The illustrated four-by-four matrices of FIG. 5 are 

file servers and between file servers and clients, a massively exemplary, and those with skill in the art will recognize that 

parallel network system is very desirable. Such a system is the matrix dimensions may vary. In many applications of 

described below applicable to the video jukebox system massively parallel networks according to the present 

described above. The massively parallel network is dis- 35 invention, the matrices will be much larger, 

closed in patent application Ser. No. 08A82,282, and the In the description of the network of FIG. 5, it is helpful to 

present patent application is a continuation-in-part of appli- refer to the location of each client node and resource node 

cation Ser. No. 08A82,282. by a matrix location CN(x,y) and RN(x,y) where x is a row 

Typically, large client-server computer network systems number and y is a column number. In each array 121 A and 

exhibit topology having a single file server that acts as the 40 121B in FIG. 5, the row and column numbers are labeled by 

center of the system's operations. The file-server is usually numbers in parentheses. For example, node 115 has a matrix 

based on a microprocessor, and is dedicated to handling position 121A(1,1) and node 116 has a matrix position 

large data manipulation and flow as requested by a number 121A(1,2). In matrix 121 B node 117 occupies position 

of clients. Clients, or client nodes, may be a number of 121B(1,1). 

different electronic devices including but not limited to: 45 In the embodiment illustrated by FIG. 5, matrix 121 A 

desktop workstations, personal computers, mainframe or functions as a client array and matrix 121 B functions as a 

minicomputers, telecommunication equipment and dumb resource array. The distinction is by the nature of connec- 

terminals. System resources are typically provided by large tions to the nodes in each array. 

electronic storage devices associated with the file server. The nodes in the client array connect by communication 
These resources include data, application programs for 50 links to client networks. Two such networks 123A and 123B 
clients, and the network operating system. The file server, having client stations such as stations 127 are shown con- 
operating according to the network operating system, per- nected to node 115 and to node 118. These client networks 
forms traffic management functions and provides security may be configured as any one of many local area network 
for the data. The file server also performs information configurations known in the art, or remote network configu- 
retrieval and may do computations or specific record 55 rations implemented by such as telephone links. There are 
searches within a database. many known arrangements for connecting such client 
Client nodes and file servers in computerized networks groups. In a full implementation, each client station in the 
such as Ethernet, ARCnet and AppleTalk must be connected client array connects to a client network. Also, there is no 
via a transmission medium, commonly some form of requirement that each client network be of the same form 
cabling. The physical layout (topology) of a large client- 60 and nature. 

server network routes all client requests to the file server. In this embodiment, matrix 121B functions as a resource 

Conventional bus systems limit the number of direct con- array. Resource nodes are connected by communication link 

nections. To maintain an acceptable degree of connectivity to resource devices. One such connection 125 A links 

such networks typically employ a hub or concentrator con- resource node 117 at position 121B(1,1) to a hub 126 A 

nection as a subsystem. The hub serves as a junction box for 65 leading to resources shown as generic disk drives 128. A 

connected nodes and passes the data between client and file similar connection 125B is shown linking resource node 114 

server by a separate dedicated network trunk. Large network at position 121B(1,4) to a hub 126B connected to other 
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generic resources 128. In a relatively simple on resource array 147 at matrix position 147(3,1). In this 
implementation, each resource node is linked to a single embodiment, the PCBs are supported in a case 136, and each 
resource, and in a full implementation, each resource node IC node on each PCB has a dedicated bus port with a 
may be connected to a hub connecting several resources. connector positioned in a wall of case 136. For example, IC 
The system in this embodiment is massively parallel by 5 141, a client node on PCB 145, links to communication port 
virtue of the communication links between nodes. Hie nodes 133 via bus ^> ^ IC 143 > a resource node on PCB 147, 
in each row in each array in this example are connected links 10 resource port 135 via resource bus 139. There are 32 
serially in a ring. For example, in matrix 121B, in row (1), connectors, of which 16 are client network ports for con- 
node (1,1) is linked to node (U), which is linked to node necUon . to chent netwodo, and 16 are resource ports for 

(1,3), which is linked in turn to node (1,4). Node (1,4) is 10 co 5?* lu « .J? r ?£ u . ro ?- t .„ . . , . . 

i • i j i a . j « ,\ iL c 1 i • i j * Those with skill in the art will recognize that the charac- 

hnked back to node (1,1). so the four nodes are linked in a , - «• 4 , . . . 4 . 

m o- -i i j ^\ « r/% »\ tenstics of the connectors will depend on the characteristics 

ring Similarly nodes ^) and are 0 f the buses connected, and there are many choices in the art. 

connected in nng 124, and soon There m be circuitry associa ted with each port for modu- 

The nodes m each column are also serially ring connected lating bctwecn ^ daU charactcristics of cach nctwork or 

in the same manner as described above for rows. For 15 resource link and the associated bus to each IC in the system, 

example, in matrix 121B, nodes (1,1), (2,1), (3,1), and (4,1) System 131 may also comprise support circuitry for a 

are connected in ring 130. Similarly the nodes of column 2 conventional computerized system such as, but not limited 

are ring connected in ring 132, and the nodes of column 3 to, a BIOS system and power supply. These elements are not 

and column 4 are similarly ring connected. shown in FIG. 6A. 

The unique connection scheme results in each node in the 20 In an alternative embodiment, system 131 also comprises 

resource array being linked to each adjacent node in its row circuitry to monitor each port for information management 

position and in its column position. By virtue of the ring purposes such as determining the nature of the connection, 

nature of the connection, each node is connected by com- For example, installed SCSI and/or Ethernet equipment, 

munication link to four other nodes in the array. Also, it is not strictly required that there be a dedicated port 

The row by row and column by column ring connection 25 for each IC node on both matrices. A lesser number of ports 

is duplicated in the client array 121A. To complete the may be provided, with some ports serving more than a single 

massively parallel connectivity in this embodiment, each node in the massively parallel architecture, 

client node is connected to a resource node. In this embodi- FIG. 6B is a largely diagrammatical isometric illustration 

ment the connection is by matrix position. For example, of a portion of each of PCBs 145 and 147 in the embodiment 

client node 115 at position 121A(1,1) is linked to resource 30 shown in FIG. 6 A Client node 151 on PCB 145 commu- 

node 117 at position 121B(1,1) by link 119. A similar link nicates via links 144 to the four adjacent nodes 148A, 148B, 

(not shown) is established between 121A(1,2) and 121B(1, 148C and 148D, The links in one direction are a part of the 

2), between 121A(1,3) and 121B(1,3), and so on. row ring connection previously described, and the links in 

The communication flexibility of the system shown may the other direction are a part of the column ring connection 

be illustrated by following a request for data from any client 35 previously described. 

station 127 on network 123 A linked to client node 115 at Resource node 153 on PCB 147 communicates via links 

position 121A(1,1). In this example the data request is for 146 to the four adjacent nodes 150A, 150B, 150C and 150D. 

data stored at a resource device 128 on link 125B connected Again the links in one direction are a part of the row ring 

to resource node 114 at position 121B(4,1). From client node connection previously described, and the links in the other 

115 the data request may be routed via any one of five 40 direction are a part of the column ring connection previously 

branches, each of four to an adjacent client node, or to described. Links 144 and 146, and other links between nodes 

resource node 117 at position 121 B( 1,1) via link 119. In this not shown, may be any one of a wide variety of known 

example, assume the request is routed directly to the communication connection types, including, but not limited 

resource array via link 119, as might be preferable in a to parallel, serial and optical digital and/or analog transmis- 

low- demand state. 45 sion links. The necessary hardware and firmware for man- 

At resource node 117 there are four choices for routing, aging the communication at each node is a part of the 

one link to each of the four adjacent resource nodes. The circuitry at each node, and depends on the nature of the 

fifth link, to resources on link 125 A, is not an option, links. For example, if a communication link is a serial 

because the request is for data available only on link 125B. connection, the modulation and demodulation circuitry for 

The most direct route, assuming the next node is not busy, 50 converting digital data to and from the serial protocol is a 

is directly from resource node 117 to resource node 114, part of the circuitry at each node. Also, although the nodes 

which is an adjacent node in ring 130. In considering are described as single ICs, this structure is preferable and 

alternative routing, the very large number of choices is not required, each node could as well be implemented in two 

immediately apparent. or more ICs with connective traces and structure. 

FIG. 6A is an isometric view of a massively parallel 55 Although not explicitly shown in FIG. 6B, nodes 151 and 

network system substantially according to the arrangement 153 are an associated pair in the matrix geometry (see 

described above with reference to FIG. 5. System 131 description of matrices above). That is, nodes 151 and 153 

comprises two printed circuit boards (PCBs) 145 and 147, have the same (x,y) address on different arrays. Accordingly, 

and each PCB comprises a matrix of integrated circuits (ICs) these two nodes are connected by another communication 

as nodes linked by communication links substantially as 60 link 142. Moreover, a client LAN 155 is connected to client 

shown for the nodes of the arrays of FIG. 5. PCB 145 is a node 151, and a resource link 157 is connected to resource 

client array and PCB 147 is a resource array. Each IC node node 153. Similar links, not shown, are made to the other 

on each PCB comprises a microprocessor. resource nodes and client nodes in FIG. 6B. Although it is 

PCB 145 in this embodiment comprises 16 ICs in a 4x4 not required, in the preferred embodiment described, 

matrix, and PCB 47 comprises 16 ICs in a 4x4 matrix, just 65 arrangement of the nodes in square matrix arrays on PCBs, 

as in FIG. 5. IC 141 is located, for example, on client array and alignment of the PCBs, brings associated nodes in 

PCB 145 at matrix position 145(4,2), and IC 143 is located proximity for connection. 
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FIG. 7 is a block diagram plan view of client node 151 219 represents a portion of a client array, and ring 221 

according to a preferred embodiment of the present inven- represents a portion of a resource array. The portion 

tion. The same drawing may represent resource node 153 represented, in the terms of the above descriptions, could be 

and other nodes in either matrix. A node is a client node or either a single row or a single column in each array, 

a resource node by nature of connection to resources or s Connections in each array in the third dimension are not 

clients, rather than by particular physical structure. shown for simplicity. 

Node 151 comprises a CPU 181, a memory unit 183 and In FIG. 8, client nodes are labeled CI, C2, . . . C7, and 

routing bridge circuitry 185. In this embodiment the resource nodes are labeled Rl, R2, ... R7. A client network 

memory unit is random access memory (RAM). It will be 223 is connected to client node C5 and has a client 225 as 

apparent to those with skill in the art that other types of 10 a station on the network. A resource is represented as a 

electronic memory may be used as well. hard-disk drive 227 connected to resource node R6. 

Control routines stored in memory 183 are accessed and Although not shown to keep the diagram simple, there may 

operated by CPU 181 to manage data flow and logical be other resources connected to any of the resource nodes 

functions for the local node. Outputs from CPU 181 con- R1-R7, and to other resource nodes not shown. Also, other 

figure bridge circuitry 185 for routing requests and data in 15 client networks may be connected to the client nodes 

the network. In node 141, CPU 181 is linked to RAM 183 C1-C7, and other client nodes not shown. Separate 

by bus 187 and to bridge 185 by bus 189. A third bus 188 resources and clients can be connected in network fashion to 

in this embodiment links bridge circuitry 185 with memory nodes preferably only up to the ability of the transmission 

183. In one embodiment, bus 188 has an extra wide band- protocol on the client networks and resource branches to 

width. 20 handle full load transfer without delay. 

Links 144 are links to adjacent nodes on the same PCB as In the instant example, client 225 requests a movie, or, in 

described above. Link 155 is the link to a client LAN in this the case of a video jukebox clipping service, as described 

example via an outside connector, and link 157 is the link to above, a video clipping, stored at resource disk 227. Each 

an associated node in the resource array. In the case of a client station has digital intelligence substantially configured 

resource node, link 157 would be the link to a resource or a 25 like the node illustrated in FIG. 7, and described above. That 

resource hub. An advantage of RAM at each node is that is, each station has a microprocessor, a memory, sending and 

control routines may be accessed and updated, and orches- receiving circuitry for the client network, and control rou- 

trated from outside computer equipment to provide for tines executable by the microprocessor to compose and 

optimum operation. transmit requests and to receive and process requested data. 

An important purpose of the massively parallel arcbilec- 30 Client 225 has a schedule of movies available, or, in the 

ture according to embodiments of the present invention is to case of the video jukebox service, a list of available 

provide resources from numerous points to clients at numer- clippings, and an input apparatus for making a selection, 

ous other points while minimizing delay and maximizing When the client makes a selection, the digital system at the 

data flow rate. This is accomplished by providing a very client station may consult a lookup table and assign a 

large number of alternative paths (massive interconnection) 35 resource code to the transmission, or all selection transmis- 

for requests and data, and by providing intelligent nodes for sions may be sent to an account manager. One or more of the 

routing the data and requests through the massively parallel resource nodes, or even client nodes, may be assigned the 

architecture in an efficient manner. To accomplish this end, task of account managing for the system. In this example 

as stated and described above, each node has a resource node R4 is account manager 229. 

microprocessor, thus machine intelligence, together with 40 The account manager has control routines for accounting 

stored instructions and information for accomplishing effi- and scheduling in addition to routing routines, and has 

cient routing. It will be apparent to one with skill in the art location information for clients and resources on the mas- 

that there are many alternative schemes for routing that may sively parallel network. In the case of a single account 

be used, and that the control routines might take any of a manager, all the resources and clients are mapped at the 

large number of forms. 45 single manager, and regular maintenance updates for 

In one embodiment, each node is provided with a map of changes in resources and clients (new clients subscribe, 

clients and resources, detailing to which nodes the clients some discontinue the service, new clippings become 

and resources directly connect. Moreover, in this available, older clippings may be discontinued). There may 

embodiment, each node is "aware" of its own position in the be more than one account manager to share the duty and 

network architecture. 50 reduce the load effect at a single manager. 

The essential nature of much information to be routed In the case of a single account manager, the instant 

through such a network is analog. For example, such net- example, the client makes a selection, and the client station 

works are useful for routing television (video) programs and codes the data and transmits it on the client LAN to client 

chppings from storage (resources) to clients on a network. node C5. The coded data includes one or more bits address- 

The essential nature of the network and the nodes is digital. 55 ing the account manager, one or more bits identifying the 

Although there are a number of ways data may be trans- client, and bits identifying the movie title requested. There 

mitted between nodes, such as parallel bus and serial link, may be other information, such as a particular time for 

the data is managed digitally at each node. transmission, or special information pertaining to charges, 

Following the example of video networking for such as etc. 

TV movies, clippings, and other selective programming, 60 The general process at client node C5, and at other nodes 

FIG. 8 is a two-dimeosional slice through a massively as well, is that incoming transmissions are immediately 

parallel network in an embodiment of the present invention, stored in the node memory, along with priority association 

dedicated to providing TV movies and/or chppings to cli- for re-transmission. Beyond C5 there is a wide choice of 

ents. FIG. 8 may also be taken as an example of a Video available paths to account manager 229. The necessary 

Jukebox system based on the massively parallel concept, as 65 intelligence for routing is stored at each client and resource 

described above. The same diagram may represent a mas- node. For example, from C5, there are two apparently equal 

sively parallel network for many other applications. Ring "best choices" to R4 (account manager 229). One is to R5, 
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then to R4. The other is to C4, then to R4. There may be 
some reason in particular implementations why one of these 
two choices is "best", in which case that path will carry the 
first priority. If there is no such, one or the other may be first 
priority arbitrarily. 

In one embodiment, the means of routing is "run and 
shoot"; that is, the node having data for retransmission has 
test routines for testing the available alternatives by priority, 
and, on finding a path open, passes the transmission on to a 
next node. The destination code determines which of five 
connections (three are shown) is on the shortest, or best, 
path, and the CPU tests that connection. If the node at the 
other end is not busy, the request is immediately retrans- 
mitted and deleted from memory. 

If R5-R4 is the highest priority path from C5 to R4, the 
CPU at C5 will first poll R5. If R5 is available, retransmis- 
sion takes place; if it is not, the next node in priority is tested, 
and so forth, until the stored data for retransmission, in this 
case, client 225's request for a movie or clipping, is sent on. 

In the case of requests from clients, routed to an account 
manager, each request is a short burst, typically a single data 
word of 16 or 32 bits, requiring only a very short transmis- 
sion duration. In this case of transmission of information like 
a movie, the situation is somewhat different, as is described 
in more detail below. 

It will be apparent to those with skill in the art that there 
is a broad variety of ways routing may be prioritized and 
determined. Substantially all are based on priority and 
testing of some sort. 

When client 225's request for a movie or clipping arrives 
at account manager 229, the request is processed. Client 
225' s account is charged for the particular movie time or 
clipping requested, and the updated account is then available 
for whatever billing cycle is in use. The account manager 
also associates the material (movie or clipping) requested 
with the resource location, and initiates the process of 
sending the data to client 225's site. 

The transmission of a command packet issued by the 
account manager to resource 227 via resource node R6 to 
cause the requested movie data to be transmitted to client 
225 is similar to the transmission of the original request from 
client 225 to the account manager. The necessary informa- 
tion packet is rather small, requiring such as destination 
(node R6), movie ID on resource 227, time of transmission, 
and so forth. The routing of this command packet is accom- 
plished by priority and testing, as described above. At R6 the 
command packet is stored and processed. 

The transmission of a complete movie or clipping, which 
may have a playing time measurable in from several minutes 
to an hour or more, instead of milliseconds, is a different 
proposition than transmission of a request or a command 
packet. FIG. 9 represents the total data length of a movie in 
transfer time of length DS. In disk 227 the total data string 
is stored in sectors, each providing, when processed, for 
example, 1 minute of viewing time of the movie. A movie of 
three hours length, then, would be stored and processed in 
180 sectors SI, S2 . . . , S180. Initial sectors SI, S2, S3, S4, 
are indicated in FIG. 9. Each sector, although it represents a 
full minute of viewing time, can be transmitted in perhaps 
milliseconds as digital data from node to node in the 
massively parallel network, depending on the characteristics 
of the data paths and modes of transmission. 

In the instant example, Node R6, having received the 
command packet from the account manager, executes the 
commands according to stored control routines. Node R6 
retrieves a first sector (SI), stores that sector in its local 
memory, and transmits it on toward client 225 in the same 
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manner as described above for routing requests and com- 
mand packets. R6 continues to retrieve, store, and delete 
until it has sent along all of the sectors for the movie or 
clipping, after which it may (or may not) issue an acknowl- 

S edgement to the account manager, depending on the vagaries 
of the particular protocol and application. 

Given the massively parallel nature of the network, 
wherein each node has four connections in the same array 
(resource or client), and one each to the opposite array, and 

10 either a resource trunk or a client LAN connection, there is 
no guarantee that consecutive sectors will follow a common 
path from resource 227 to client 225. Unless the loading is 
low, it is not likely. There is no need, however, for all of the 
sectors of the movie to follow one another in sequential 

15 fashion or even to arrive in order. 

Each sector transmitted through the maze of the massively 
parallel network is coded (sector #, destination, etc.), and as 
each sector arrives at client LAN station 225, it is recorded 
in memory according to prearranged addresses. After at least 

20 one sector is available, the playback may begin, by convert- 
ing the available data to video signals and transmitting the 
signals to the video display. In most cases this is a CRT video 
tube, but that is not a requirement. As other types of displays 
(LCD, ELD, etc.) become more common for TV and high 

25 definition TV, the equipment at the client station can be 
updated to operate with the later apparatus. 

FIG. 10 is a massively parallel network according to an 
embodiment of the invention wherein the resource array and 
the client array are configured as nested tori. In this example 

30 the outer torus is a client array 111 and the inner torus is a 
resource array 113. Each intersection on client array 111 and 
resource array 113 is a node in the massively parallel 
network. In another embodiment the position of the client 
array and resource array may be reversed. The torus repre- 

35 sentation geometrically is equivalent to matrix array like that 
presented in FIG. 5. FIG. 10 is meant to illustrate the toroidal 
nature of the interconnecting geometry, and no attempt has 
been made to match nodes by position or number. 

In FIG. 10 a portion of the outer torus (client array) is 

40 shown cut away to illustrate the inner torus (resource array). 
A single client node 201 is shown connected to a single 
resource node 203 and to a client LAN 207 having at least 
one client station 208. Each client node is connected in two 
rings, one around the major diameter of the torus, and the 

45 other around the minor diameter, as is each resource node on 
the opposite torus array. Resource node 203 is connected to 
a resource hub 209 having at least one resource 210. These 
elements are exemplary and representative. Although not 
shown in FIG. 10, each resource node is connected to a 

50 client node and to a resource hub, and each client node is 
connected to a resource node and a client LAN. 

It will be apparent to those with skill in the art that the 
nested torus arrangement is illustrative and not limiting. The 
same connectivity is illustrated in the matrix arrays of FIG. 

55 5, wherein the node at the end of each row is connected back 
to the first node in the row, and the node at the bottom of 
each column is connected back to the node at the lop of the 
column. 

In one embodiment, the tori are configured as PCBs 
60 locally to fit inside a case 211 similar to the case illustrated 
and described with reference to FIG. 6A. Case 211 would 
have the required number of I/O ports equal to the total 
number of client nodes and resource nodes. 
In this alternate embodiment of the invention, the mas- 
65 sively parallel network architecture may be applied as a 
large transaction system in real time. For example, a banking 
system may be implemented by allocating client nodes to 



04/19/2004, EAST Version: 1.4.1 



US 6,490,725 B2 



15 



16 



different local bank branches with dedicated communication 
trunks to tellers* workstations and ATM machines. ATM 
limits could be relaxed because each customer's balance 
may be updated quickly throughout the system. Massively 
parallel network architecture allows for flexibility in data 
resource configuration and allows for a large number of 
branch banks to maintain current transaction status. 

In the transactional banking application described above, 
the resource array and the client array might both be local, 
perhaps as shown in FIG. 6 A, or in some other local 
arrangement. In this case there would be communication 
trunks from the local client nodes going to the different 
branch or ATM locations. In an alternative arrangement, the 
client nodes might be remotely located at the branch or 
ATM. 

In another embodiment of the invention, massively par- 
allel network architecture could manage large data flow in a 
paperless company. For example, a large business may have 
as many as 100 fax lines, each capable of generating a page 
of fax containing approximately 30 kilobits about every 
fifteen seconds. In this application, some client nodes may 
service several users* fax requests and some resource nodes 
may be dedicated to fax modems, attached telephone lines 
and media storage devices for storing faxes. In this 
configuration, a business can effectively manage fax flow, 
reducing the need for a large number of fax machines and 
telephone lines. 

It will be apparent to one skilled in the art that there are 
many changes that might be made without departing from 
the spirit and scope of the invention. For example, relative 
to the massively parallel network system, any number of tori 
may be nested within one another and effectively intercon- 
nected by the addition of communication links. Massively 
parallel network systems according to embodiments of the 
invention can be reconfigured from without for different 
applications or to update data and operating protocol for an 
existing application. 

In a further aspect of the massively parallel portion of the 
present invention, a massively parallel system may be 
re-configured at times of system expansion. A system- wide 
hashing control routine could redistribute resource locations 
according to results of tracked transactions to provide for 
optimal performance. In these and other applications and 
embodiments, massively parallel network architecture 
according to the invention can provide effective, real-time 
access for a large number of users. 

In various embodiments within the spirit and scope of the 
invention, microprocessors of many sorts and manufacture 
may be used. The same variability applied to memories and 
auxiliary circuitry, such as routing circuitry. Nodes may be 
accomplished as single ASICs, as described in embodiments 
herein, or in more than one IC. Similarly the variability of 
programmed control routines is very great, and the means of 
prioritizing and routing is similarly variable within the spirit 
and scope of the invention. 

There are many ways to geometrically arrange nodes for 
such a system as well. This variability is illustrated above by 
the representation of essentially the same system as two 
levels of matrix arrays, and as nested tori. But the physical 
arrangement and relationship of nodes to one another is not 
limited by any one of the suggested arrangements. The 
connectivity is the principle constraint. There are many other 
alternatives not herein discussed that still should be consid- 
ered as within the spirit and scope of the invention. 

What is claimed is: 

1. A method of providing video entities to users, com- 
prising the steps of: 
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storing data identifying a user's interests; 

receiving video entities at server, the server being one of 

a plurality of servers distributed across a wide area 

network at which the video entities are received; 
transmitting to the user via a digital data link notification 

of receipt of a video entity corresponding to the data 

identifying the user's interests; and 
downloading via the digital data link the video entity 

corresponding to the data identifying the user's interest 

to the user from the server. 

2. The method of claim 1, further comprising the step of 
accumulating data regarding video entities downloaded to 
the user. 

3. The method of claim 2, further comprising the step of 
preparing billing data for downloading of video entities. 

4. The method of claim 1, wherein the step of notifying 
the user of receipt of a video entity comprises forwarding an 
e-mail to the user. 

5. The method of claim 1, further comprising the step of 
maintaining a database comprising information identifying 
topics of interests to which video entities relate. 

6. The method of claim 5, further comprising the step of 
searching the database for video entities corresponding to 
the user's interest. 

7. The method of claim 1, further comprising the step of 
loading new video entities and distributing the new video 
entities to the plurality of distributed servers. 

8. The method of claim 7, wherein loading new video 
entities comprises identifying topics of interests to which the 
new video entities relate. 

9. A method of providing video entities to users, com- 
prising the steps of: 

receiving copies of video entities at a plurality of servers 

distributed across a wide area network; 
maintaining a database of users' topics of interests; 
identifying video entities corresponding to users' topics of 

interests; 

transmitting to the users via digital data links notification 

of receipt of video entities corresponding to users' 

topics of interests; and 
downloading to users via the digital data links video 

entities corresponding to users' topics of interests from 

plurality of distributed servers. 

10. The method of claim 9, further comprising the step of 
accumulating data regarding video entities downloaded to 
users. 

U. The method of claim 10, further comprising the step 
of preparing billing data for downloading of video entities, 

12. The method of claim 9, wherein the step of notifying 
users of video entities comprises forwarding e-mails to 
users. 

13. The method of claim 9, further comprising the step of 
maintaining a database comprising information identifying 
topics of interests to which video entities relate. 

14. The method of claim 13, further comprising the step 
of searching the database comprising information identify- 
ing topics of interests to which video entities relate for video 
entities corresponding to users' interests. 

15. The method of claim 9, further comprising the step of 
loading new video entities and distributing the new video 
entities to the plurality of distributed servers. 

16. The method of claim 15, wherein loading new video 
entities comprises identifying topics of interests to which the 
new video entities relate. 
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17. A system for delivering video entities, comprising: 

a plurality of servers distributed over a wide area 
networke, each of the plurality of distributed servers 
operable to receive video entities distributed to all of 
the servers; and 

at least one additional server, said at least one additional 
server operable to store data identifying users* topics of 
interests, transmit to users notification of receipt at said 
plurality of geographically distributed servers of video 
entities corresponding to users' topics of interests, and 
initiate downloading of video entities corresponding to 
users' topics of interest from the plurality of geographi- 
cally distributed servers to users. 

18. The system of claim 17, further comprising video 
input apparatus for loading new video entities and distrib- 
uting new video entities to said plurality of distributed 
servers. 
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19. The system of claim 17, wherein said at least one 
additional server is further operable to accumulate data 
regarding video entities downloaded to users. 

20. The system of claim 19, wherein said at least one 
additional server is further operable to prepare billing infor- 
mation for users. 

21. The system of claim 17, wherein said plurality of 
distributed servers and said at least one additional server 
communicate over a wide area network. 

22. The system of claim 17, wherein said at least one 
additional server is operable to forward e-mails to users 
notifying users of receipt of video entities corresponding to 
users interests. 

23. The system of claim 17, wherein said at least one 
additional server comprises a plurality of servers. 
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